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Is the —> v s oscillation solution to the atmospheric neutrino anomaly 
excluded by the superKamiokande data? 
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q ! Abstract 

Recently the SuperKamiokande collaboration have claimed that their data exclude the 
— > v s solution to the atmospheric neutrino anomaly at more than 99% CL. We critically 
examine this claim. 
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Something mysterious with neutrinos is a foot. It is clear that about half of the upward 
going atmospheric v'^s are mising jl],0. Furthermore, about half of the solar v' e s have also 
disappeared p|. There is also strong evidence that v e <-> oscillations take place with 
small mixing angles from the LSND experiment 0. An elegant explanation of these facts 
is that each neutrino oscillates maximally with an approximately sterile partner, with small 
angles between generations ||. For the status of the maximal u e — > v s solution to the 
solar neutrino problem, see Ref. M. The status of the maximal — > v s solution to the 
atmospheric neutrino problem is the subject of this paper. 

As was pointed out sometime ago 0, both — > u s and — > v T oscillations are able 
to explain the sub-GeV and multi-GeV superKamiokande single ring events (while 2 flavour 
Vn — > u e oscillations cannot because there is no observed anomaly with the electron events 
||). Recently, however, the SuperKamiokande Collaboration have argued that the — > v s 
oscillation explanation of the observed deficit of atmospheric neutrinos is disfavoured at 
more than 99% C.L. while the interpretation interms of — > v T oscillations fits all 
of their data extremely well. This conclusion relies on an analysis of the upward through 
going muon data (UTM), the partially contained events with E vis iu e > 5 GeV(PC) and the 
neutral current enriched multi-ring events (NC). These data sets lead to slightly different 
expectations for the — > v T vs — > v s oscillations because of earth matter effects for 
v ii —> v s oscillations which are important for UTM [1C] and PC events [11,3 wri ile neutral 



current interactions in the detector are utilized for the NC events Ul2| . These three data 
sets, obtained from Ref. |J (for 1100 live days), are shown in Figures la,b,c. Also shown is 
the theoretically expected result for maximal — > v s oscillations with Sm 2 = 3 x 10 -3 eV 2 
also obtained from Ref. H. SuperKamiokande analyse the data by taking particular ratios 
and have not as yet provided detailed justification of the systematic uncertainties in the 
theoretically expected rates. 

Let us discuss each of the three data sets in turn: 

a) Upward through going muons: The overall normalization of the through going muon fluxes 
have an estimated 20 % uncertainty, however the uncertainty in the expected shape of the 
zenith angle distribution is significantly lower (for some discussion of these uncertainties, see 
Ref. |I3] , P^] ). A recent estimate [^] of the uncertainty in the vertical/horizontal ratio due 



to the uncertainties in the atmospheric fluxes is of order 4%. This systematic uncertainty 
is dominated by the uncertainty in the ratio K/tt produced in the atmosphere from the 



interactions of cosmic rays |13[ . In addition there will be other uncertainties in the shape 
of the zenith angle distribution due to the uncertainty in the energy dependence of the 
neutrino - nucleon cross section |] and from cosmic ray muons masquerading as neutrino 
induced muons. The latter uncertainty, while mainly affecting the most horizontal bin 
(—0.1 < cos© < 0) may be very important, as we will show. 

b) Partially contained events (with E visMe > 5 GeV). The systematic uncertainty in the 



t Uncertainties in the energy dependence of the cross section leads to uncertainties in the expected 
shape of the zenith angle distribution of UTM events, because the zenith angle dependence of the 
atmospheric neutrino flux is energy dependent. 
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expected normalization of these events is quite large, again of order 20% [13|,14|. The 
systematic uncertainty on the expected shape of the zenith angle distribution of these events 
should be relatively small (~ few% in the up/down ratio). 

c) Neutral current enriched multi-ring events. The systematic uncertainty in the expected 
normalization is again quite large, of order 20-40% due to the highly uncertain cross sections 
(as well as the uncertain atmospheric fluxes). The uncertainty in the expected shape of the 
zenith angle distribution will of course be much smaller, but may be significant (i.e. of order 
5% in the up/down ratio). The uncertainty is due in part to the uncertainty in the relative 
contributions due to v e interactions (which are expected to be approximately up/down 
symmetric) and interactions (which are up/down asymmetric due to the oscillations 
affecting the upward going z/^'s). The relative contributions due to the neutral current weak 
interactions and the charged current weak interactions will also be uncertain. In addition 
to the cross section uncertainties there are also the uncertainties in the scattering angle 
distribution between the angles of the multi-ring events and the incident neutrino. 

Note that the normalization uncertainties between the three data sets will be largely 
uncorrelated because of the different energy ranges for the atmospheric neutrino fluxes and 
also because of the different cross sections involved. Nevertheless, some weak correlation 
between UTM and PC events may be expected. While analysing the data using ratio's does 
eliminate the normalization uncertainty, the remaining uncertainties will be important for 
the data sets a) and c). Furthermore, a conclusion based on particular ratios could only be 
robust if it agreed with a x 2 At of the binned data points. SuperKamiokande are in the best 
position to do this for their data, and we hope that they will do this at some point. 

In the meantime we will do this using the superKamiokande theoretical Monte-Carlo 
results for their given test point of maximal mixing with Sm 2 = 3 x 10~ 3 eV 2 (which is not 
expected to be the best fit for z/ M — > u s oscillations). We define the x 2 by: 



2 — 2,2,2 /i\ 
Xtotal — XUTM i* Xpc i* XnCi \ L ) 



with 



v 2 _ y ( data y {i) - f y x theory y {i) \ ( f y - l \ 

Xy \ 6data y (^ ) \ Sf ) ' 1 ) 

where y = UTM, PC, NC and the sum runs over the 10 zenith angle bins, and 5data y is 
the statistical uncertainty in the data, data y (i). The normalization factor, f y parameterizes 
the overall normalization uncertainty in the theoretical expected value, theory y (i) , and 5f y 
is the expected normalization uncertainty, and we take Sf y = 0.2 for y = UTM, PC, NC. It 
is understood that x\ is minimized with respect to f y . 

Doing this exercise (using the superKamiokande experimental data, data y {i) , 5data y (i) 
and also the superKamiokande theoretically expected results theory y (i) for maximal mixing 
with 5m 2 = 3 x 10~ 3 eV 2 ), we find that x% is minimized when fuTM — 0.90, f PC — 0.87 
and fjsic — 1-07. In Figures 2a,b,c we compare the data with f y theory y {i), which is the 
theoretical prediction for 5m 2 = 3 x 10~ 3 eV 2 (neglecting systematic uncertainties in the 
shape). We obtain the following x\ values: 

Xutm = 17.0 for 10 degrees of freedom, 
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Xpc = 13.4 for 10 degrees of freedom, 

X%c = 16.0 for 10 degrees of freedom. (3) 

Thus we obtain Xtotai — 46 for 30 degrees of freedom which corresponds to an allowed C. 
L. of about 3%. While this allowed CL. is low, it is only a lower limit because we haven't 
varied 5m 2 or incorporated the systematic uncertainties in the shape of theory y (i), which 
we now discuss. 

Varying 5m 2 within the allowed region identified from a fit to the contained events 
should improve Xpc somewhat as well as slightly improving Xutm nc- F° r example, for 
Sm 2 = 5 x 10~ 3 eV 2 using our code developed in Ref. |7[ we find that Xpc — 12 (c.f. 13.4 
for 5m 2 = 3 x lO" 3 eV 2 ). 

With regard to the UTM and NC events the effect of systematic uncertainties on \ 2 can 
be very dramatic. We illustrate this by introducing a slope factor s(i) defined by 

s (i) = 0.95 + 0.01 *i, (4) 

where % = 1,...,10 (with i = 1 the vertical upward going bin). In Eq.(^) we replace 
fuTMii) — * s if) * fuTNiii), which is roughly within the estimated 1-sigma systematic un- 
certainty for the UTM events. In fact, this would be roughly equivalent to reducing the 
atmospheric Kj tt ratio by about 30 — 40% to be compared with the estimated 25% uncer- 
tainty for the K/tt ratio [|l^]. While the uncertainty in the K/n ratio may be the largest 



single contribution to the uncertainty in the shape of the zenith angle distribution of UTM 
events, the total systematic uncertainty in the shape of the zenith angle distribution gets 
many contributions [] which is why the slope factor in Eq.(^j) might be expected to be 
roughly within the 1-sigma systematic uncertainty. With the above slope factor, we find 
Xutm — 13) which represents a significantly improved fit. From our ealier discussion, the 
systematic uncertainties in the shape of the zenith angle distribution of the events for UTM 
and NC events are expected to be completely uncorrelated. This means that the best fit for 
the NC events can have a slope factor with a slope of a different sign, and this is needed to 
improve the fit. To illustrate the effect then, for NC we replace /jvc(^) — > fNc(i)/s(i) and 
find Xnc — 12. This demonstrates that a \ 2 fit to the three data sets incorporating the 
systematic uncertainties and varying 5m 2 would be expected to reduce Xtotai by a l least 9 
leading to a Xtotai °f about 37 or less. This corresponds to an allowed C.L. of 15% or more. 
Of course a global fit of all the superKamiokande data gives a much larger allowed C.L. 
because of the excellent fit of the — * v s oscillations to the lower energy contained events 
(both sub-GeV and multi-GeV) |I5|1 . The results obtained for UTM and NC events using 
the slope factor s{%) are given by the dotted lines in Figure 2a, c. 

We would also like to emphasise that the poor \ 2 fit f° r UTM events is due largely to 
the most horizontal bin (—0.1 < cos© < 0). Excluding this bin we find that 

Xutm = 12-5 for 9 bins (5) 



* Due to e.g uncertainty in the energy dependence of the neutrino nucleon cross section, uncertainty 
in the interaction length of the cosmic rays in the upper atmosphere, modelling of the atmosphere, 
uncertainty in the primary cosmic ray energy spectrum and composition of cosmic rays etc. 
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excluding any systematic uncertainty in the shape of the zenith angle distribution (i.e. with 
s(i) = 1). The reason for questioning the horizontal bin is clear: It is expected that the 
systematic uncertainty for the most horizontal bin should be relatively large. This is because 
atmospheric muons can contribute. (In fact the Kamiokande collaboration []16| made the cut 
cos0 < —0.04 and incorporated large systematic errors for this bin). SuperKamiokande, 
in their published analysis of 537 days [|17| included the whole horizontal bin, and made an 



estimate of the contamination of atmospheric muons in this bin (of order 4%) and subtracted 
it off. This is based on an extrapolation from cosO > where the background falls off 
exponentially. This exponential assumption is not discussed in any detail, and needs to be 
justified if it can be. In fact, from their Figure 1 []I7|, which compares the distribution of 



through-going muons near the horizon observed by superKamiokande for regions with thick 
and thin rock overburden, it seems possible that the atmospheric muon background could be 
higher by a factor of two or three or even more. This is rather important. For example, if a 
background of 10% is assumed (which means that we must lower the superKamiokande data 
value by 6% for this bin), then we obtain a Xutm — 14 f° r 10 degrees of freedom (excluding 
the effects of the systematic uncertainties in the shape of the zenith angle distribution, i.e. 
s(i) = 1) or Xutm — H including the modest slope factor in Eq.([|). Unless the level of 
contamination of atmospheric muons in the horizontal bin can be rigorously justified, it is 
probably safest to exclude the horizontal bin altogether because the systematic uncertainties 
may be so large as to make it too uncertain to be useful^. 

Thus, we have shown that a \ 2 analysis of the recent upward through going muon 
binned data, partially contained events with E visi u e > 5 GeV and neutral current enriched 
multi-ring events does not exclude maximal — » v s oscillation solution to the atmospheric 
neutrino problem with any significant confidence level. This is not inconflict with the su- 
perKamiokande results since they fit three particular ratio's rather than the binned data. 
However it does show that the conclusion that the — > v s osillations are disfavoured does 
depend on how one analyses the data. Furthermore, the overall fit (i.e. including also the 
lower energy single ring events) of the — > v s oscillations to the superKamiokande data 
is good. Fortunately future data will eventually decide the issue. In the meantime, impor- 
tant work needs to be done on carefully estimating and checking the possible systematic 
uncertainties. 
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Figure Captions 

Figure 1: SuperKamiokande data for the upward through going muons (Fig. la), partially 



s In terms of analysis with ratio's we suggest that the vertical be defined as — 1 < cos© < —0.5 
and the horizontal as —0.5 < cos© < —0.9. 
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contained events with E visi bi e > 5 GeV (Fig. lb) and neutral current enriched multi-ring 
events (Fig.lc), all obtained from Ref. ||. Also shown are the superKamiokande expected 
results for maximal — > v s oscillations with Sm 2 = 3 x 10~ 3 eV 2 , also obtained from Ref. 

!• 

Figure 2: Same as Figure 1 except that the theoretical expectation for maximal z/ M — > v s 
oscillations with Sm 2 = 3 x eV 2 , are renormalized by an overall scale factor (as discussed 
in the text). In Figures 2a and 2c, the dotted line includes the effect of a modest correction 
to the expected shape of the zenith angle distribution given by Eq.([|), as discussed in the 
text. 
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